Area laws in quantum systems: mutual information and correlations 
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The holographic principle states that on a fundamental level the information content of a region should depend 
on its surface area rather than on its volume. In this paper we show that this phenomenon not only emerges in the 
search for new Planck-scale laws but also in lattice models of classical and quantum physics: the information 
contained in part of a system in thermal equilibrium obeys an area law. While the maximal information per unit 
area depends classically only on the number of degrees of freedom, it may diverge as the inverse temperature in 
quantum systems. It is shown that an area law is generally implied by a finite correlation length when measured 
in terms of the mutual information. 



Correlations are information of one system about another. 
The study of correlations in equilibrium lattice models comes 
in two flavors. The more traditional approach is the investiga- 
tion of the decay of two-point correlations with the distance. 
A lot of knowledge has been acquired in Condensed Matter 
Physics in this direction and is now being used and developed 
further in the study of entanglement in Quantum Information 
Theory UlSlstl- The second approach (see FigJTJi asks how 
correlations between a connected region and its environment 
scale with the size of that region. This question has recently 
been addressed for a variety of quantum systems at zero tem- 
perature 
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are due to entanglement which in turn is then measured by the 
entropy. 

The original interest in this topic HUES El 03 came from 
the insight that the entropy of black holes scales with the area 
of the surfaces at the event horizon — we say that an area law 
holds, in this case with a maximal information content of one 
bit per Planck area. Remarkably, a similar entropy scaling is 
observed in non-critical quantum lattice systems while criti- 
cal systems are known to allow for small (logarithmic) devi- 
ations JE S S S Ell- Both is in sharp contrast to the 
behavior of the majority of states in Hilbert space which ex- 
hibit a volume scaling rather than an area law. These insights 
fruitfully guided recent constructions of powerful classes of 
ansatz states which are tailored to cover the relevant aspects 
of strongly correlated quantum many -body systems JlH 171. 

A heuristic explanation of the area law in non-critical sys- 
tems comes from the existence of a characteristic length scale, 
the correlation length, on which two-point correlations decay 
(Fig ID- Intuitively this apparent localization of correlations 
should imply an area law, an argument which can, however, 
not easily be made rigorous A firm connection between the 
decay of correlations and the area law is thus still lacking as 
well as is a proof and extension of the latter beyond zero tem- 
perature. In the present work we address both problems by 
resorting to a concept of Quantum Information Theory — the 
mutual information. The motivation for this quantity is that 
(i) it coincides with the entanglement entropy at zero temper- 
ature; (ii) it measures the total amount of information of one 
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FIG. 1: We are interested in the mutual information (or entangle- 
ment) between the two regions A and B. Heuristically, if there is a 
correlation length £ then sites in A and B that are separated by more 
than £ (the shaded stripe) should not contribute to the information or 
entanglement between A and B. The mutual information (or entan- 
glement) is thus bounded by the number of sites at the boundary. 



system about another without 'overlooking' hidden correla- 
tions; (iii) the area law can be rigourously proven at any finite 
temperature; (iv) the heuristic picture relating decay of cor- 
relations and area law can be made rigorous in the form of a 
one-way implication. Moreover, we will prove that an area 
law is fulfilled by all mixed projected entangled pair states 
(PEPS), discuss the behavior of the mutual information for 
certain classes of ID systems in more detail, and show that a 
strict ID-area law implies that the state has an exact represen- 
tation as a finitely correlated state. 

We begin by fixing some notation. We consider systems 
on lattices A C lP in T> spatial dimensions which are suf- 
ficiently homogeneous (e.g., translational invariant). Each 
site of the lattice corresponds to a classical or quantum spin 
with configuration space or Hilbert space C d respectively. 
Given a probability distribution p on A and marginals pa, Pb 
corresponding to disjoint sets A,BCA, the mutual informa- 
tion between these regions is defined by 



I(A : B) = H{ PA ) + H( PB ) - H{p AB ), 



(1) 



2 



where H(p) = — P( x ) ^°SP( X ) i s trie Shannon entropy. 
In the quantum case the p's become density operators (and 
their partial traces) and H has to be replaced by the von Neu- 
mann entropy S(p) = — tr[plogp]. The mutual information 
has a well defined operational meaning as the total amount of 
correlations between two systems 11911 . It quantifies the in- 
formation about B which can be obtained from A and vice 
versa. Elementary properties of the mutual information are 
positivity, that it vanishes iff the system factorizes, and it is 
non-increasing under discarding parts of the system 10. We 
will occasionally write Sa meaning S(pa)- 

Area laws for classical and quantum systems: Let us start 
considering classical Gibbs distributions of finite range in- 
teractions. All such distributions are Markov fields, i.e., if 
xa,xc,%b are configurations of three regions where C sep- 
arates A from B such that no interaction directly connects A 
with B, then p(xa\xc, %b) = p(xa\%c) holds for all con- 
ditional probabilities [with p(x\y) := p(x,y)/ p(y)]. Let us 
denote by d A, dB the sets of sites in A, B which are con- 
nected to the exterior by an interaction. Exploiting the Markov 
property together with the fact that we can express the mu- 
tual information in terms of a conditional entropy H(A\B) = 
H(A) — I(A : B) then leads to an area law 

I {A : B) = I(dA : dB) < H(dA) < \8A\ logd, (2) 

where the first inequality follows from positivity of the classi- 
cal conditional information. Equation (f2l) shows that correla- 
tions in classical thermal states are localized at the boundary. 
In particular if we take B the complement of A, then we ob- 
tain that the mutual information scales as the boundary area 
of the considered region and the maximal information per unit 
area is determined by the number of microscopic degrees of 
freedom. 

For quantum systems less information can be inferred from 
the boundary and the Markov property does no longer hold 
in general. Remarkably enough, for the case of the mutual 
information between a region A and its complement B we 
can also derive an area law for finite temperatures. In order 
to show that, we consider again a finite range Hamiltonian 
H = Ha + Hg + Hb, where Ha, Hb are all interaction terms 
within the two regions and Hg collects all those crossing the 
boundary. The thermal state pab corresponding to the inverse 
temperature (3 minimizes the free energy F(p) = tr[Hp] — 
jjS(p). In particular, F(pab) < F(pa ® Pb) from which we 
obtain 



I(A : B) < (3 tr[Hg( PA ® p B - Pab)] 



(3) 



since Ha, Hb have the same expectation values in both cases. 
As the r.h.s. of Eq.© depends solely on the boundary we 
obtain again an area law scaling similar to that in Eq.©. 
For example, if we just have two-site interactions we obtain 
I(A : B) < 2/3\\h\\\dA\, where \ \h\\ \ is the maximal eigen- 
value of all two-site Hamiltonians across the boundary, i.e., 
the strength of the interaction. Note that the scale at which the 
area law becomes apparent is now determined by the inverse 



temperature j3. In fact, it is known that at zero temperature 
the boundary area scaling of the mutual information, which 
then becomes I(A : B) = 2S(A), breaks down for certain 
critical systems 0, 0, H H [ll ■ Eq.© shows that all the 
logarithmic corrections appearing in these models disappear 
at any finite temperature. 

By comparing the area laws (O and ([3]) we notice that quan- 
tum states may have higher mutual information than classical 
ones as the information per unit area is no longer bounded by 
the number of degrees of freedom. In fact, our results imply 
that if a system violates inequality (O, then it must have a 
quantum character. Note that Eqs. (1213b directly generalize the 
findings of 12111 for systems of harmonic oscillators. 

Let us now turn to an important class of quantum states 
which goes beyond Gibbs states, namely projected entangled 
pair states (PEPS) lfl6ll . These states bear their name from 
projecting 'virtual spins', obtained from assigning entangled 
pairs |$) = ^2f =1 \H) to the edges of a lattice, onto physical 
sites corresponding to the vertices. A natural generalization 
of this concept to mixed states is to use completely positive 
maps for the mapping from the virtual to the physical level 
11811 . Since every such map can be purified, these mixed PEPS 
can be interpreted as pure PEPS with an additional physical 
system which gets traced out in the end. For all these states 
one can now easily see that the mutual information between a 
block A and its complement B satisfies a boundary area law 



I(A : B) < 2\dA\\ogD, 



(4) 



since it is upper bounded by the mutual information, i.e., 
twice the block entropy, of the purified state which is in turn 
bounded by the number of bonds cut. An interesting class of 
mixed PEPS are Gibbs states of Hamiltonians of commuting 
finite range interactions (see appendix). Note that these are 
not necessarily classical systems, as a simultaneous diagonal- 
ization need not preserve the local structure of the interaction. 
The Kitaev model 112211 on the square lattice, the cluster state 
1 2311 Hamiltonian and all stabilizer Hamiltonians fall in this 
class. Moreover, Gibbs states of arbitrary local Hamiltonians 
are approximately representable as mixed PEPS 1 24] . 



Mutual information and correlations: We will now dis- 
cuss the correlations measured in terms of the mutual informa- 
tion between separate regions. Traditionally, correlations are 
measured by connected correlation functions C(Ma, Mb) '■= 
{M A ® M B ) - (Ma) (M b ) of observables M A , M B - In fact, 
these two concepts can be related by expressing the mutual in- 
formation as a relative entropy S (pab \pa ® P b) = I (A : B), 
using the norm bound S(p\a) > |||p — a\\\ 12511 and the in- 
equality ||AT||i > trpn^]/||y||. In this way we obtain 



I(A : B) > 



C(Mj 



,M B ) 2 



2\\M A \ 



M, 



(5) 



Hence, if I(A : B) decays for instance exponentially in the 
distance between A and B then so will C. One of the advan- 
tages of the mutual information is, that there cannot be cor- 
relations 'overlooked', whereas C might be arbitrarily small 
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FIG. 2: Left: We consider regions A and B separated by a spherical 
shell of thickness L <C R; Right: Simple ID model for a state which 
is formed by singlet pairs (indicated by lines joining them) whose 
length follows a given probability distribution. 



while the state is still highly correlated — a fact exploited in 
quantum data hiding and quantum expanders l2rl . 

In the following we will relate the correlation length as de- 
fined by the mutual information with the area law mentioned 
previously. To this end consider a spherical shell C of outer 
radius R and thickness L « fl which separates the inner re- 
gion A from the exterior B (see Fig. We denote the mutual 
information between A and B by Ii (R) and define £m as the 
minimal length L such that Il(R) < Jn(i?)/2 for all R, i.e., a 
correlation length measured by the mutual information. Note 
that £m can be infinite (e.g., for critical systems) and that it 
takes into account the decay of all possible correlations. Us- 
ing the subadditivity property of the entropy we obtain the 
general inequality I(A : BC) < I (A : B) + 2S C which 
leads to 



Jo < I €m + 2S C < 4|&4|£ 



(6) 



Here the first inequality implies the second one by inserting 
I$m < \h and the fact that S{C) < £ M \9A\ . So, indeed, 
we get an area law for the mutual information solely from the 
existence of the length scale which expresses the common 
sense explanation of Fig. [TJ This area law is also valid for 
zero temperature and when violated immediately implies an 
infinite correlation length The converse is, however, not 
true since there are critical lattice systems which obey an area 
law 112 lL 12711 . Surprisingly, an area law can even hold under 
algebraically decaying two-point correlations 11211 12711 . 



Examples in one dimension: We will now investigate the 
decay of correlations in terms of the mutual information for 
certain simple cases. We will show that in all of them £m is 
directly connected to the standard correlation length. We will 
consider infinite lattices in 1 spatial dimension (see Fig. |2). 

We start out by considering an important class of states, 
the so-called finitely correlated states (FCS) ll28ll . which nat- 
urally appear in several lattice systems in ID. They can be 
viewed as ID PEPS (or matrix product states). Every FCS is 
most easily characterized by a completely positive, trace pre- 
serving map (a channel) T : B(Ti,-,) — > B(H 1 ® TL2) with 



H.i,H.2 Hilbert spaces of dimension D, d respectively. Define 
further £(x) = tr2[T(x)] and assume the generic condition 
that £ has only one eigenvalue of magnitude one. The sec- 
ond largest eigenvalue, rj, is related to the standard correla- 
tion length through £ ~ — 1/lnr/. In order to estimate £m 
we exploit the fact that pab factorizes exponentially with in- 
creasing separation L, i.e., \ \pab — Pa® Pb\\i = 0{e~ L ^) 
(see appendix). Moreover, T can be locally purified thereby 
increasing the size of H2 by a factor of dD 2 . Denoting the ad- 
ditional purifying systems by A' and B' respectively, we ob- 
tain on the one hand I(A : B) < I(AA' : BB 1 ) = S(p A A> ® 
Pb b' )—S(oaa' bb')- On the other hand we can apply Fannes' 
inequalityHl, \S(p)-S(a)\ < A log(<5 — 1) +U(A, 1 — A), 
where A = | \\p — a\ |x and S is the dimension of the support- 
ing Hilbert space, to I(AA' : BB'). Due to the purification 
we deal with finite dimensional systems (6 = D 2 ) so that 
putting things together leads to 



I L (R) <log{D)0(Le 



(7) 



Since Il(R) increases (decreases) with R (L), and is lower 
bounded by correlation function (0 this inequality immedi- 
ately implies that £m is finite and directly related to £. 

The case considered above includes several interesting 
situations of systems in ID with finite-range interactions: 
frustration-free Hamiltonians at T = 0, all classical Gibbs 
states, and all quantum ones for commuting Hamiltonians. In 
all cases, the area law is fulfilled following the results given 
in the previous sections. However, it is known that for certain 
critical local Hamiltonians the area law is violated at T = 0. 
In order to analyze how this behavior may emerge, we will 
considered a simple toy model in ID for which Il(R) can be 
exactly determined. 

Let us consider a spin \ system formed of singlets (see Fig. 
|2). The state is such that from any given site, i, the probability 
of having a singlet with another site, j, is a function f(\i 
The mutual information between two regions is equal to the 
number of singlets that connect those regions, and thus it can 
be easily determined (if we take a large region, so that we 
can average this number). If we take f(x) oc e~ x >^ we have 
that: (i) all (averaged) correlation functions decay exponen- 
tially with the distance and that £ gives the correlation length; 
(ii) Il{R) decays exponentially with L and that £a/ ~ £; (hi) 
an area law is fulfilled. If we take f(x) oc l/(x 2 + a 2 ) we 
obtain that: (i) the correlation functions decay as power laws 
with the distance; (ii) Il(R) ~ log(2i? — L) and thus £^ 
is infinite; (iii) the area law is violated. Thus, for this spe- 
cific model we see how the violation of the area law naturally 
implies an infinite correlation length. 

For zero temperature there is another simple connection be- 
tween the area law and the decay of Il(R) as a function of 
the separation L. If for a pure state the entropy of a block 
of length L goes to a constant K as Sl = K — f(L) with 
f(L) — » for increasing L, then Il(R) f(L) as R — > 00 
for sufficiently large L. If the block entropy diverges instead, 



4 



then II (R) — ► oo for every finite separation. 



PEPS representation of thermal stabilizer states 



Saturation of mutual information implies FCS: For one- 
dimensional systems the area law just means a saturation of 
the mutual information. Let us finally gain some first insight 
into the structure of states having this property. So consider 
a general (mixed) ID translational invariant state and denote 
the mutual information between a block of length L and the 
rest of the system by I(L) and similarly its entropy by S(L). 
The latter can be shown to be a concave function 



S(L) > (S(L-l)+3(L+l))/2, 



(8) 



which is nothing but the strong subadditivity inequality ap- 
plied to a region of length L — 1 surrounded by two single 
sites. Eq.® has strong implications on the behavior of I(L). 
Assume that the system is a finite ring of length N, then 

/(L)-I(L-l) = [S(L)-S(L-1)} (9) 
-\S(N-L + 1)-S(N-L)] 

is a difference between two slopes of the entropy function. 
Due to concavity of S(L), I(L) is increasing as long as 
L < N/2. Moreover, if from some length scale on the mutual 
information exactly saturates, i.e., I(L — 1) = I(L) then all 
slopes between L and N — L have to be equal so that strong 
subadditivity in Eq.® holds with equality. States with this 
property are, however, nicely characterized ifioll and known 
to be quantum Markov chains. That is, there exists a channel 

f:B(Hf L - l) )^B(H® L ) such that 



(id®f)(p L _i) =p L , 



(10) 



where pz is the reduced density operator of L sites and suc- 
cessive applications of T to the last L— 1 sites generates larger 
and larger parts of the chain. For infinite systems these states 
form a subset of the FCS where now D = d^- 1 ), i.e., the 
scale at which saturation sets in determines the ancillary di- 
mension needed to represent the state. 
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APPENDIX 

In this appendix we show that (i) every Gibbs state of a 
local quantum Hamiltonian with mutually commuting inter- 
actions is a mixed projected entangled pair state (PEPS) with 
small bond dimension, and (ii) finitely correlated states fac- 
torize exponentially, i.e., exhibit an exponential split property. 



PEPS G3i bear their name from projecting 'virtual spins', 
obtained from assigning entangled pairs $) = J2iLi I**) to 
the edges of a lattice, onto physical sites corresponding to the 
vertices. A natural generalization of this concept to mixed 
states is to use completely positive maps for the mapping from 
the virtual to the physical level III 811 . Since every such map 
can be purified, these mixed PEPS can be interpreted as pure 
PEPS with an additional physical system which gets traced 
out in the end. To become more specific let us consider a 
2D square lattice. Then every pure PEPS is characterized by 
assigning a 5'th order tensor A l r , d to each lattice site. Here 
the upper index corresponds to the physical site and the lower 
'virtual' ones (running from 1 to D) get contracted according 
to the lattice structure. A mixed PEPS is then obtained by 
increasing the range of i from d to dd,E and finally tracing over 
these additional environmental degrees of freedom, which can 
be thought of as a second layer of the square lattice. 

Let us now prove that all Gibbs states of Hamiltonians of 
commuting finite range interactions are mixed PEPS. For sim- 
plicity consider again a 2D square lattice. Starting point is to 
write the un-normalized Gibbs state as e~P H ' 2 le~P H ' 2 and 
to interpret the 1 as a partial trace over maximally entangled 
states $ <g> $) to which e~@ H ' 2 is applied. In order to get an 
explicit form for the tensor A assume that horizontally neigh- 
boring sites interact via hh and vertical neighbors via h v and 
denote by 



,-Vhh/2 



= Y^Rp®L p (11) 





Schmidt decompositions in the Hilbert-Schmidt Hilbert space. 
That is, the operators U a , D ai Rp, Lp form four sets of or- 
thogonal operators, which by assumption commute with each 
other but not necessarily among themselves (e.g. [Ui, U2] ^ 
0). Using that the Gibbs state is up to normalization a product 
of terms as in Eq. dTTb leads then to its PEPS representation 
with D — d 2 and 



(12) 



where i = (ii, i-x) with 12 corresponding to the environmental 
degrees. 



Decay of correlations for Finitely correlated states 

We consider now so called finitely correlated states (FCS) 
lEitl . which naturally appear in several lattice systems in ID. 
They can be viewed as ID PEPS (or matrix product states) 
where all the local projectors are the same. Every FCS is most 
easily characterized by a completely positive, trace preserving 
map (a channel) T : BiH^ -> B{H X <g) H 2 ) with Hi,H 2 
Hilbert spaces of dimension D, d respectively. Define further 
£(x) — tr^pXx)] and assume the generic condition that £ 
has only one eigenvalue of magnitude one, corresponding to a 
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fixed point g = £(g). The second largest eigenvalue, rj, is re- 
lated to the standard correlation length through £ = — 1/ In rj. 
With this notation, it is very simple to express the states cor- 
responding to regions A, B, and AB (which are required in 
order to determine the mutual information). We now show that 
as L gets larger, pab approaches exponentially fast pa® Pb- 
The reduced density matrix pa of Na = R — L contiguous 
sites is obtained as 



PA = tn t Na { 6 ) 



(13) 



Similarly the joint reduced state of two regions A and B which 
are separated by L sites is given by 



PAB 



lim tri 

N B -*oo 



For sufficiently large L write 



£ L {x) = (1 - cif)tr[x]Q + cn L £'{x), 



(14) 



(15) 



where £' is some channel and c an L-independent constant. 
Taken together Eqs.( fT3lfT5l l enable us to bound the norm dis- 
tance 



\PAB - PA ® /OB ||l < 4C77 Z 



(16) 



independent of Na, Nb- That is, the two regions factorize ex- 
ponentially on a scale £ = — 1/ In r\ which can be regarded 
the correlation length of the system. We cannot use this result 
directly for the mutual information since the dimension of the 
Hilbert space of system B is infinite. However, we can pro- 
ceed by noting that each T can be locally purified thereby 
increasing the size of Ti.2 by a factor of dD 2 (with £ un- 
changed). Denoting the additional purifying systems by A' 
and B' respectively, we obtain on the one hand I(A : B) < 
I {A A' : BB') = S( P aa> ® Pbb>) - S( PA a>bb>)- On the 
other hand we can apply Fannes' inequality, \S(p) — S(a)\ < 
Alog(<5 - 1) + H(A,1 - A), where A = \\\p - a\\i 
and 6 is the dimension of the supporting Hilbert space, to 
I{AA' : BB'). The advantage is that in this system we deal 
with finite dimensional systems with 6 = D 2 . 
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